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Abstract. We give an equivalent finitary reformulation of the classical 
Shannon-McMillan-Breiman theorem which has an immediate translation 
to the case of ergodic quantum lattice systems. This version of a quantum 
Breiman theorem can be derived from the proof of the quantum Shannon- 
McMillan theorem presented in [2]. 

1. Introduction 

In classical probability and information theories the Shannon-McMillan 
theorem was proved by Breiman in an almost sure version, saying that with 
probability one along a trajectory (message string) the individual proba- 
bility decreases exponentially at a rate given by the entropy rate h of the 
ergodic stochastic process (over a finite alphabet). From the point of view 
of data compression and coding this means that the message string will 
not only belong to a typical set of approximate size e nh at a given time n 
with overwhelming probability, as is guaranteed by the original Shannon- 
McMillan theorem, but it will eventually be captured in the sequence of 
typical sets almost surely. So sequential coding at entropy rate should be 
possible (and in fact, the Lempel-Ziv algorithm is such a sequential coding 
scheme). 
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It is natural to ask for a corresponding result in the quantum context. In 
the quantum situation the notion of an individual trajectory is at least prob- 
lematic. So it is not at all obvious what could be an analogue of Breiman's 
result. The approach chosen here is to give an equivalent reformulation of 
the classical Breiman result which allows an immediate translation into the 
quantum setting. In fact, the typical subsets according to Breiman's theorem 
are not isolated objects, one for each n, but comprise bundles of trajecto- 
ries and hence can be chosen being chained in the sense that the predecessor 
subset consists exactly of the same sequences, only shortened for one letter. 
This simple observation leads to a finitary, simple and equivalent statement 
of Breiman's theorem avoiding the notion of a trajectory. Substituting typ- 
ical subsets by typical subspaces of Hilbert spaces, the property of them to 
be chained can be expressed easily in terms of partial traces. It turns out 
that the proof of the quantum Shannon-McMillan theorem presented in [2], 
which is based to a substantial part on the earlier work of Hiai and Petz [3], 
yields the necessary tools to prove that typical subspaces can be chained. 

2. A finitary reformulation of the Shannon-McMillan-Breiman 
theorem 

Consider an arbitrary (not necessarily stationary) stochastic process P with 
a finite set A as state space. So P is a probability measure on [v4 z ,2l z ] 
where 2l z is the cr-field generated by cylinder sets. Let h be a non-negative 
real number. We say that P satisfies the condition (B) (with respect to h) 
if for P-a.e. sequence (£ n )rtez the limit — ^ logP^((^j)f =1 ) exists and 
equals h. Here P( n ) is the marginal of P on the cartesian product := 

nr=i a 

The Shannon-McMillan-Breiman theorem asserts that ergodic P satisfy 
(B) with h being the entropy rate of the process. 

Let x = (xi)f =1 be a finite sequence from A* = \J km A( k \ We denote 
by X|, the sequence (x^)™", 1 obtained from x by omitting the last symbol. 

Definition 2.1. We say that P satisfies condition (B*) with respect to h if 

for each e there exists a sequence {c| n ^} ne N of subsets of A^ n \ respec- 
tively, and a number N(e) such that 

1. C^ = (d n+ \forn>l 
( sets are chained) 

2. #C £ (ri) G (e< h - s \e< h+£ ^)forn > N(e) 
(exponential growth rate) 

3. P(")(x) < e~'< h -^ for n > N(e) and any x eC £ (ri) 
( upper semi-AEP) 

4. p( n )(C £ (ri) ) > 1-e 
(typical sets). 
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Except for the concatenation condition (1) these are known properties of 
the typical sets for the case of a stationary ergodic P. Condition (3) is a 
weakened version of the well-known Asymptotic Equipartition Property 
(AEP), particularly it ensures that h is an asymptotic entropy rate in the 
general (possibly non-stationary) situation. 
We obtain the equivalence assertion 

Lemma 2.1. A probability measure P on [A z , satisfies (B) iff it satisfies 
(B*). 

The proof is entirely elementary. Observe that (1) describes a tree graph of 
one-sided infinite trajectories. 

Proof of Lemma 2.1: 

1. Assume that (B) is fulfilled. Let 

A {M ,e) ■= {X G A Z \ pW((xi)? =1 ) G ( e -n{h+e/2) je -n(h-e/2) )t 

Vn > M}. 

Obviously (B) implies P{A^ M ^) ^ — > 1 for fixed e. So there is some 
M(e) with P(>l(M(e),e)) > 1 - £• Define 

:= {y G A^\ 3x G A {M(e)>e) : ( yi )?=i = (^)?=i}, 

let fc(e) = min{/c G N|(l - e ) e fe ( /l - £ / 2 ) > e^"^} and set N(e) = 
max{fc(e), M(e)}. Then (l)-(4) are easily derived, taking into account that 
bounds on probabilities imply bounds on cardinality. So (B*) is a conse- 
quence of (B). 

2. Assume (B*) to be satisfied. Then it is easy to see that we find a 

( n \ 

chained sequence {C £ } and some N(e) which fulfil (l)-(4) and even the 

full AEP condition 

P (n) (x) G ( e -"( /l + £ ) , e -^- £ ) ) , Vn > N(e) , Vx eC £ n) . 
In fact, define 

A £ (n) := {xG.4 Z | (*,)?=! GC>)} 

and observe that A £ (n) \ A £ , where A e is the tree of trajectories asso- 
rt— >oo 

ciated with {C £ n ^}. Condition (4) implies P{A £ ) > 1 - e. Now let 

A £ (n) := {x G A e (n)| pW((x^ =1 ) < e ~< h+2 ^}. 

By (2) it follows that P{A £ (n)) < #C e (n) • e -^ h + 2 ^ < e~ n£ . 
The Borel-Cantelli lemma implies now that P([j n>m A £ (n)) \ 0, 
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so there is some m(e) with P({J n>m ^ A £ (n)) < e. Let N{e) := 
max{iV(£/2), m(e/2), k(e)} (where k(e) was defined above) and 

C { ; ] : = {( Xi )ti € C$| 3w G A e/2 : K)?=i = (^)f=i, 
P (fc) ((^)f =1 ) > e - k{h+£ \ Vk > N(e)}. 

We have, denoting by A £ the trajectory tree associated with {C^}, 

P (n)(c^)>p(A £ ) = P(A £/2 \ |J I £/2 (n)) 

«>]?(£) 

> 1 -e/2 -e/2 = 1 - e. 

Thus (4) is established. (1) and the e-AEP are clearly fulfilled, and (2) fol- 
lows from the AEP as in step 1. Now (B) follows immediately. □ 

3. A quantum Shannon-McMillan-Breiman theorem 

We are now in a position to formulate and prove a quantum version of 
Breiman's theorem. With this paper being a continuation of [2] we adopt 
all settings from there, for simplicity only considering the one-dimensional 
case. That means that ^4°° is a quasilocal C* -algebra over Z constructed 
from a finite dimensional C*-algebra A. For m, n G Z with m < n we 
denote by «4r mi „] the local algebra over the discrete interval [m, n] C Z 

and use the abbreviation A^ for ^[i, n ], n G N. Instead of A[ njn \ we write 
A[ n ]. Recall that for a stationary, i.e. shift-invariant state & on A°° the mean 
entropy s is defined as 

s := lim -Sf&W), 

where S^™)) := -trD^ logD (ri) is the von Neumann entropy of &( n \ 
the restriction of the state ^ to the local algebra A^ n \ and is the den- 
sity operator from A^ corresponding to the state tp'W. 
Let A be a self-adjoint element of a local algebra A[ m>n y Then R(A) de- 
notes its range projector and tr^q (A) is the partial trace of A over the local 
algebra A[ k ,t\ C A[ 

Observe that for the case that the underlying algebra is abelian the fol- 
lowing theorem reduces to the classical (reformulated) Breiman assertion. 
So it can be considered as a quantum analogue of the SMB theorem. 

Theorem 3.1. Let & be an ergodic state on the quasilocal C*-algebra A°° 
with mean entropy s. Then to each e > there is a sequence of orthogonal 

projectors {p^}^=i in A^ n \ respectively, and some N(e), such that 
(ql)pi n) = i?(tr n+1 (pi n+1) )), 
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(n) 



tr(j4 n) ) 

Pi and 



^ n \pi) < e -"( s - £ ) ifn > N(e), 
(q4) ^ n \pi n) ) > l-e. 



Remark: It is a well known fact that each finite dimensional unital *- al- 
gebra A is isomorphic to 0* =1 B(Hi), where Hi are finite dimensional 
Hilbert spaces. According to this representation, we may associate to each 

chained projector in the theorem above a typical subspace of H® n with 



1 . Let e > be given. Choose an integer / > sufficiently large such that 
the entropy of satisfies s < jS(\P^) < s + e 2 . Take a complete set Vi 
of mutually orthogonal spectral projectors for Let B denote the abelian 
subalgebra of A^ generated by these projectors. The completeness of Vi 
implies that B is maximal abelian. Furthermore the entropy of \P^ |g, the 
restriction of IP® to the subalgebra B, is identical to S(\P®). Generally we 
have the relation 

= mm{S(^ \ C )\CC A^ max. abelian subalgebra}. (3.1) 

The quasilocal algebra B°° constructed from B is an abelian subalgebra 
of A°° and \P acts on this algebra as a stochastic process P/ with alpha- 
bet Vi. The Shannon mean entropy hi of this process can be estimated by 
s < jhi < jS(\P® \b) < s + e 2 . The first inequality is a consequence of 
(3.1). Pi is a stationary, but not necessarily ergodic process. We apply the 
corresponding version of the classical Shannon-McMillan-Breiman theo- 
rem (cf. [4], [1]) to this process and obtain that there is a set of trajectories 
y* c y% Q f measure one suc h ^at for each (vj)jgz £ the limit (indi- 
vidual mean entropy) h((vi) ie z) ■= lim„_»oc -\ log P/ n) ((^)f =1 ) exists, 
and we have E/i((vj)j e z) = hi. 

2. Let V['~ C V t * be the subset of those trajectories, for which 
the relation jh((vi) ieZ ) < s - e 2 holds. We have P/(Vf'~) = 0. In 
fact, consider the sets w/ n) '~ := {{wi)f =1 € y/ n) |P/ n) (Mf=i) > 
e -n«(s-e 2 )| obviously containing the sets := {(vi)f =1 \ 3(wi)i & i G 

Vf ~ with (Wi)f =1 = (vi)f =1 and P, (m) ((«i)£i) > e"" 1 ^-^ forallm> 
n}, respectively. This means that p/ n) (W, (n) ") > p/ n) (VJ (n) '"). The 
cardinality of each W^' is bounded from above by e n K s -£ 2 )_ Now 
suppose Pi(V, £ '~) > 0. Then for n sufficiently large we would have 

P, W (^ B)r ) > c for some c > implying p/ n) (W, (n) '~) > c. For the 
quantum state this would have the consequence that for large n there are 
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projectors p(»0 := E {w . )%ieW W,- ®i=i w i with tr < e n ' (s " £2) 

and \p( nl ) (p( nl )) > c . This contradicts Proposition 2.1 in [2], saying that 
no sequence of projectors in A^ nl \ respectively, of significant expectation 
can have asymptotically a smaller trace than e nl ( s ~ e \ 

3. Let V[' + C Vj* be the subset of those trajectories, for which the 

relation j/i((t>i)iez) > s +e holds. By 2. and by the relation Kh((vi)i e z) = 
hi we obtain 

h > l(s - e 2 )(l - PiiV^)) + l(s + e)Pi(V^ + ) 

resulting in P/(Vf ' + ) < 2e. 

4. Combining the preceeding results we can easily derive for each e > 
the existence of an I and of some N(e) such that there is a subset V t * C V t * 
with the properties 

(a) Pi(V*) > l-e, 

(b) e - n '( s+£ ) < P/ n) ((wi)f=i) < e- n '( s - £ ) for each ( Wi ) ieZ G VJ* 
and n > iV(e). 

Indeed, assume e < 1 (otherwise we would obtain the result above with e 2 
instead of e) and set A lfi := Vf\ (vf'~ U^' + ). We have Pi{A ij£ ) > l-e 
and A h£ C U n > n fe >„ 4% where 

A ( ? == {(«4)<eN| " \\ogPl k \(v t )U) e (i(s - + e))} . 

Then there exists JV(e) € N such that Pi(T\k>N{e) A^) > 1 - e. The set 
VJ* := rifc>Ar(e) fulfills both conditions above. 

Obviously V t * generates a sequence of chained sets {C^}^ =1 fulfilling 
1-4 given in section 2. In the given situation, we may reformulate these 
properties as follows: 

(a) Ci n) = (d n+1) ) b forn>l 

(b) #ci n) G (e^(s-£) 5 e nJ(«+e)) for n > N ( £ ) 

(c) ^ nl \p) < e - ni ( s - £ ) for n > iV(e) and any p = <S) k=1 v k , where 
(«*)2=i ed B) 

(d) ^ ) (E ( ^ i6C (n)®Ll^)>l-^ 

Now it is easy to define chained projectors, first for multiples of I: 

K)£ =1 eci n) 



Chained Typical Subspaces - a Quantum Version of Breiman's Theorem 



7 



and then for general n = ml + r, r < I by the set-up 

:= R (tr [ml+r+Um+m . 

Observe that both definitions are compatible. Obviously, by definition the 
property (ql) is fulfilled by the defined system of projectors. Next, we have 
with n = ml + r, r < I 

e n(s-2e) < #c ,(m) < ^(n)) < #C , M t r(l_ 4 ( ) 

<tr(l_ 4(0 )e n ( s+£ ) < e n ( s+2£ ) (3.2) 

for n sufficiently large. In fact, the first inequality in this chain is obvious. 
By definition we have 

. / (ml), 
ti(P £ ) 



(ml) _ ^ J'^ 

1=1 



(m) 



for certain minimal projectors q\ m from (£>(/) ) ( m ) , and 



P, 



((m+l)0 V V a {m) 



e 



j=i i=i 



for some minimal projectors t^j from -B[ m+1 j. In order to simplify our no- 
tation let 

I(m, r) := [ml + r + 1, (m + 1)Z]. 

We obtain 



\ \ 1=1 j=l 

A( P i m °) / fci 

\ i=l \ j=l 

tr( P i m °) / / fci 

i=l \ \j=l 

H P i ml) ) / I hi 

i=i \ \i=i 
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Here in the second step we made use of the mutual orthogonality of the 
q( m ) _ ^his p roves the second inequality in (3.2). The third inequality also 
immediately follows from the formula 



tr(?4 mi) ) / (hi 

So (q2) is fulfilled, too (with 2e instead of e). 

By (c) we see that (q3) is fulfilled if n is a multiple of I. In the general 
case n = ml + r observe that in the representation 

tr( P < m; ») 

p (ml + r )= £ g H 8fi l^ tr;Mfej) 
i=l \j=l 

we sum over mutually orthogonal projectors each of them fulfilling 

< &mHr) ( ? H g, ll{m r) 
= &( ml \q( m )) < e -ml(s-e) < e -n(s-2e) 

if n is sufficiently large. Now (q3) follows easily, again with 2e instead of 
e. 

Finally, we have 

^(ml+r) (p( m '+ r )) 
tr(p^ mi) ) / / k 

= y: ^w^®* Etr 7(m , r) ( %J 
i=i \ \i=i 

i=l \ \j=l 

> £ ^((-+1)0 j g M g, £ ft> . ) = ^((m+l)i) (p((m+l)J) ) > 1 _ e> 
i=l \ j=l 

where we used the Schmidt representation and (d) to obtain the last line. 
This proves (q4). □ 



(m,r) 
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